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ABSTRACT 

We reformulate the agent-based opinion dynamics mod- 
els of Weisbuch-Deffuant ||T] |2l and Hegselmann-Krause 
||3| as interactive Markov chains. So we switch the scope 
from a finite number of n agents to a finite number of n 
opinion classes. Thus, we will look at an infinite popula- 
tion distributed to opinion classes instead of agents with 
real number opinions. 

The interactive Markov chains show similar dynami- 
cal behavior as the agent-based models: stabilization and 
clustering. Our framework leads to a 'discrete' bifurcation 
diagram for each model which gives a good view on the 
driving forces and the attractive states of the system. The 
analysis shows that the emergence of minor clusters in the 
Weisbuch-Deffuant model and of meta-stable states with 
very slow convergence to consensus in the Hegselmann- 
Krause model are intrinsic to the dynamical behavior. 
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sentable as a real number Thus, agents can compromise 
by averaging their opinions. We label such dynamics as 
continuous opinion dynamics. 'Continuous' refers to the 
type of opinions not to the time. This is in contrast to 
several models of opinion dynamics which cover binary 
opinions where agents have to decide 'yes' or 'no'. 

Examples for continuous opinions are prices or the con- 
tinuum form left to right in politics. Clusters of agents 
in the continuous opinion space may represent e. g. low- 
budget vs. luxury shoppers or political parties. 

There are several more or less complex models con- 
cerning continuous opinion dynamics lIH |5] IS IT] . The 
recently most discussed models are the models of 
Weisbuch-Deffuant (WD) 1 1 1 and Hegselmann-Kxause 
(HK) |3|. Both models use very similar heuristics. We 
will present both models and focus on the dynamical dif- 
ferences in computer simulation. 

In the third section we will define interactive Markov 
Chains for both models, which lead us to 'discrete' bifur- 
cation diagrams that will give us deeper insights for the 
agent-based models. 



1 Introduction 

Consider a certain number of agents discussing a certain 
issue. Each agent has an opinion about that issue and 
they try to find a consensus. The opinion should be repre- 



2 Two Agent-based Models 

Opinion dynamics in the WD and the HK model is agent- 
based and driven by repeated averaging under bounded 
confidence. The models differ in their communication 



regime. 

Agent-based means that the number of agents n is the 
dimension of the system. The opinion of agent i E n := 
{1, . . . , 71} at the time t G N is represented by Xi{t) £ M. 
The vector x{t) £ R" is called the opinion profile at time 
step t. Both models propose a bound of confidence e G 
M>o. Agents compromise with other agents only if the 
difference between their opinions is less or equal than e. 
We will define for both models the process of continuous 
opinion dynamics as a sequence of opinion profiles. 

Definition 2.1 (Weisbuch-Deffuant Model). Given an ini- 
tial profile x(fS) G M" and a bound of confidence e G M>o 
we define the Weisbuch-Deffuant process of opinion dy- 
namics as the random process (a;(i))tgNo that chooses in 
each time step t G No two randonu agents i,j G n which 
perform the action 



= 0.23, WD model 



E = 0.23, HK model 



Xi{t)+Xj{t) 

2 

Xi{t) 



if \x,{t) - Xj{t)\ 
otherwise. 



< e 



The same for Xj {t + 1) with i and j interchanged]^ 

The dynamics in the WD model are driven by pairwise 
compromising restricted by bounded confidence. 

Definition 2.2 (Hegselmann-Krause Model). Given a 
bound of confidence e G K>o we define for an opinion 
profile X G M" the confidence matrix A{x) as 



[x,s 



ifj G Iii,x) 



otherwise. 



with /(i, x) := {j G n | \xi — Xj\ < e}. Given a starting 
opinion profile a;(0) G M", we define the Hegselmann- 
Krause process of opinion dynamics as a sequence of 
opinion profiles {x{t))t£tii„ recursively defined through 

x{t + 1) = A{x{t))x{t) 

("#" stands for the number of elements.) 

In the HK model each agent builds the arithmetic mean 
of all the opinions which are closer than e to his own. 



With 'random' we mean 'random and equally distributed in the re- 
spective space'. 

-This is a basic version of the model in 11] with fj, = 0.5. 
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Figure 1 : Example processes for the WD and HK model. 
With initial profile of 100 agents with random equally dis- 
tributed opinions within [0, 1]. 



Figure [U shows example processes for both models. In 
both models the processes converge to a stabilized opinion 
profile, where opinions have divided into a certain num- 
ber of clusters. The stabilization can be proved analyti- 
cally, even for a bigger class of models JS). The dynami- 
cal behavior can be described in the same way: The con- 
tractive force of compromising brings opinions together, 
but bounded confidence forces the agents to form clusters 
where higher local agent densities occur, thus confidence 
to other agents gets lost. 

We will briefly summarize the known results, which 
we consider in this paper. At first, results about the WD 
model. The number of expected major clusters is roughly 
the integer part of l/2£ [1]. But not all agents join the ma- 
jor clusters, some remain outliers or form minor clusters 
(like in figure[T]at the extremes). 

In the HK model there are slightly lower numbers of 
expected clusters as in the WD model, for details see f9\ . 
Convergence to consensus may take very long, due to very 
few agents remaining in the middle and attracting all other 
agents very slowly (like in figure [T] but it can be more 
drastic for larger n). 

Both models were extended in several ways. The WD 
model to relative agreement, smooth bounded confidence, 
dynamics on small world networks IJOJ , heterogeneous 
bounds of confidence, dynamics of the bounds of confi- 
dence and vector opinions |1|. Special starting distribu- 
tions were used to model a drift to the extremes [2J. The 
HK model has been extended to asymmetric JD or het- 
erogeneous bounds of confidence ifTTI . multidimensional 
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Figure 2: Added stabilized profiles (top), frequencies of 
the number of evolving clusters (bottom) for the WD (left 
hand) and the HK (right hand) model. Basic data: 100 ini- 
tial profiles with 200 agents and random opinions between 
and 1; Graphics data: stabilized profiles computed for 
e = 0, +.°.-9^, 0.4. (Dotted lines: without minor clusters.) 



opinions lfT2l . Some further proposals are in fT3\ . 

We show some statistical simulation results in figure |2] 
to give a chance to look into more details. For the graphic 
of added stabilized profiles we divided the opinion inter- 
val [0, 1] into 25 subintervals of equal size and count the 
number of agents in each subinterval. In the graphic at the 
bottom left dotted lines represent frequencies of 1 clus- 
ter and 2 clusters where we count only clusters with more 
then 5 agents, thus outliers and minor clusters are ignored. 

The number of agents n is a parameter which is not 
much studied due to computing time problems. One idea 
of the following analysis studies with interactive Markov 
chains is to get a feeling about the dynamics we will ap- 
proach with greater n. 



In this section we want to reformulate the models of WD 
and HK as interactive Markov chains. Thus, we switch 
from n agents to an idealized infinite population, which 
we divide into n classes of opinions. Instead of an opinion 
profile x{t) e R" we consider a discrete opinion distribu- 
tion p{t) e 5" := {p e [0, 1]!^" with ELi^'' = 1} 
the state of our system at time i G N. 5" is the {n — 1)- 
dimensional unit simplex of row vectors. A discrete opin- 
ion distribution is a row vector while the opinion profile is 
a column vectofl For convenience we define Pi = Q for 
all i ^ n. 

We will define transition probabilities bij{p) £ [0, 1] 
for agents in class i to go to class j. For all i e n 
should hold X)j=i ^ij{p) = 1- Thus the transition ma- 
trix B{p) = \bij{p)] is row-stochastic. The interactive 
Markov chain for an initial opinion distribution p(0) is 
the sequence of opinion distributions (p(i))teNo recur- 
sivly defined through 



p{t + l)=p{t)B{p{t)). 



(1) 



This Markov chain is called interactive (according to Con- 
lisk [14]) because the transition matrix depends on the 
state of the system in the actual time step. 

In analogy to the bound of confidence e we define a dis- 
crete bound of confidence fc G N, which defines that the 
transitions of opinions of class i can only be influenced 
by opinions of the classes i ~ k, . . . ,i -\- k. 

If we imagine that the opinions 1, . . . , n are representa- 
tives for an equidistant partition of the interval [0, 1] in the 
way i [-^i we draw a heuristic analogy ^ ^ e. 
Thus, if we go k,n ^ (X with — > e we can 'converge' 
to an agent-based model with oo agents, opinions in [0, 1] 
and bound of confidence e. 

In this setting we may consider n as a parameter how 
accurate a continuous opinion can be communicated, e.g. 
how many steps do we allow on the continuous scale from 
minimum to maximum opinion. (The topic of accuracy is 
discussed for agent-based models in 1 15 1 in the context of 
opinion versus attitude dynamics.) 

Calculation of the interactive Markov chains will be in- 
teresting regarding the following questions. 



^This is for matrix theoretical reasons: A{x) and B{p) are botli row- 
stochastic. 
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1 . Does the Markov chain produce the same dynamical 
behavior as the agent-based models? 

2. What conclusions can be drawn from the re- 
sults about the idealized infinite populations in the 
Markov Chains to the finite cases of agent-based sys- 
tems? 

3. What is the effect of the accuracy of the Markov 
chains n? 

We will start with the definiton of the WD Markov 
chain. 

Definition 3.1 (interactive WD Markov chain). We define 
the WD transition matrix for an opinion distribution p e 
and a discrete bound of confidence fc e N as 



bij{p, k) 



if i = j. 



with qi = l- J2'j^i,j=i Hp, and 



pi, if |i — / | < fc 
0, otherwise 



(Attention i in tt' is another index not an exponent!) Let 
p(0) e 5" be an initial opinion distribution. The Markov 
chain ([TJ with WD transition matrix is called interactive 
WD Markov chain with discrete bound of confidence k. 

Remember that we defined pi = Q for all i ^ n. By 
the founding idea of the WD model an agent with opinion 
i moves to the new opinion j if he compromises with an 
agent with opinion i + 2(j — i) ~ 2j — i. The probability 
to communicate with an agent with opinion 2j — « is of 
course P2j-i- Thus, the heuristic of random pairwise in- 
teraction is represented. The terms , stand 
for the case when agents with opinion i communicate with 
agents with opinion I, but the distance |i — ^| is odd. In 
this case the population should go with probability i to 
one of the two possible opinion classes [^J , ■ □ 

(This definition is inspired by the rate equation in |fT6l . 
But they used continuous time. Further on we introduced 
the discrete bound of confidence.) 

The interactive Markov chain for the HK model looks 
as follows. 



Definition 3.2 (interactive HK Markov chain). Let p G 

5" be an opinion distribution and k G N be a discrete 
bound of confidence. The k-local mean of p at j G n is 



M,ip, k) 



rn^n., \i—m\<.k 

E Pm 

ni^n,\i—m\<k 



We define (with abbreviation Mi :— Mi{p,k) the HK 
transition matrix) as 



hj{p,k) 



1 if j = Mi, 

\M,]-M, if j ^ [M,\J ^ M,, 

M,-IM,\ ifj^\M,lj^M„ 

otherwise. 



Let p{0) e 5" be an initial opinion distribution. The 
Markov chain ([T]l with HK transition matrix is called in- 
teractive HK Markov chain with discrete bound of confi- 
dence k. 

Each row of the HK transition matrix B{p, k) contains 
only one or two adjacent positive entries. The popula- 
tion with opinion i goes completely to the fc-local mean 
opinion if this is an integer. Otherwise they distribute to 
the two adjacent opinions. The fraction which goes to 
the lower (upper) opinion class depends on how close the 
fc-local mean lies to it. Thus, the heuristic of overall aver- 
aging in a local area is represented here. 

For both interactive Markov chains we define a stabi- 
lized distribution p* £ S*" as a fixed point (that means 
that it holds p* = p*B{p*)). Both models converge to 
stabilized distributions for every initial distribution, while 
the set of possible stabilized distributions is huge. This 
properties are stated by observation of example Markov 
processes. There is no formal proof at this time. 

In a first analysis step we will focus on the initial distri- 
bution p(0) £ S*" which is equally distributed pi = • ■ • = 
Pn — -^- This coincides with the agent-based model if we 
start with x G [0, 1]" where the Xi are chosen at random 
and equally distributed. 

Figure |3] shows processes for both models with n = 
101, fc = 9 (coincides with e « 0.089) at character- 
istic time stepfl We see clustering dynamics as in the 



* L'J (T'l) rounding to the lower (upper) integer. 



^The programming of the HK model is numerically vulnerable. Pro- 
gramming it like it is may lead for equally distributed initial distributions 
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Figure 3: WD and HK process for equally distributed ini- 
tial distribution with n=:101,fc = 9at characteristic time 
steps. 



agent-based models. Five major clusters emerging in the 
WD model and three major clusters emerging in the HK 
model. 

The finer scaled plots in figure|4]give more insights. It 
shows for the WD model four minor clusters in the sta- 
bilized distribution. (The distribution at t = 150 is not 
totally stabilized, but very close to the distribution it con- 
verges to. E. g. the big central cluster that we see in the 
blow-up figure 2] will converge slowly to a one bin clus- 
ter. The first two off-central clusters will converge each 
to a two bin cluster as we see it already in figure [3]) We 
got minor clusters at both extremes and two minor clus- 



to asymmetric distributions. This is theoretically impossible for sym- 
metric initial distributions. This problem is circumvented in this calcu- 
lation, by making the distribution symmetric with p = {p + fiip(p))/2 
after each time step. (flip{p)i := p„+i—i for all i G n) 
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Figure 4: Same processes as in figure|3]with finer y-scale 
at certain time steps to show minor clusters after stabiliza- 
tion for WD and minor clusters attracting major clusters 
for HK. 



ters between major clusters, which will survive forever 
The minor clusters are only visible in the blow-up figure. 
There are no minor clusters between the central and his 
adjacent major clusters. 

For the HK model we see the possibility of very slow 
convergence in the HK model on the right side in fig- 
ure [3] which can be explained by figure ID There we see 
two small clusters which hold contact between the central 
cluster and the both adjacent major clusters. The dynamic 
reaches a stabilized distribution with three major clusters 
at t = 327. We call the states from t = 10 to t = 326 
'meta-stable' because they look like stable. 

Thus, both special features that we mentioned for the 
agent-based models (minor clusters for WD model and 
very slow convergence in HK model) also occur in the 
aggregated models of the interactive Markov chains. This 
effects may be seen as artifacts by simulators but they 
should be regarded as intrinsic to the dynamic's behavior 
(at least for great numbers of agents). 

To get a complete overview about the random equally 
distributed initial distribution we will calculate a 'dis- 
crete' bifurcation diagram for both models. We will cal- 
culate the stabilized distributions for all processes for 
n = 1001 and k = 50, .+1, 300 (thus e « 0.05, . . . , 0.3). 
Our bifurcation diagram is called 'discrete' because the 
analyzed bifurcation parameter k is discrete, which does 
not fit into the usual terms of bifurcation theory. In our 
setting a bifurcation is an abrupt change in the stabihzed 
profile in one discrete step of the parameter k. 

Figure |5] and |6] show discrete bifurcation diagrams for 
the interactive WD and HK Markov chains. The gray 
scale symbolizes the masses at the specific positions: 
White is zeros, black is fair above zero and grey is slightly 
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Figure 5: Bifurcation diagram for the WD model, n = 
1001,fc = 50, ...,300. 

above zero. We see the major clusters as black lines. (No- 
tice that a fully converged cluster normally consists of two 
adjacent non-zero entries in p surrounded by zero entries. 
You can not see this in the figure.) 

We describe the bifurcation diagram for the WD pro- 
cess. At first we have to notice again that the diagram is 
not fully converged due to computation time. Going fur- 
ther on in time the gray areas would converge slowly to 
gray lines of minor clusters. Going form k = 300 down 
to 50 we see at first one central cluster and minor clusters 
at the extremes (that will converge to the total extremes), 
then the central cluster bifurcates into two major clusters 
at roughly k « 270, then a small central cluster nucle- 
ates {k « 220), the new central cluster is growing and 
the two former clusters drift away from the center. At 
A: « 150 two minor clusters emerge. At roughly 125 the 
central cluster bifurcates again into two clusters, while the 
minor clusters vanish for a short phase. The same bifurca- 
tion and nucleation procedure repeats on a shorter /c-scale 
from 125 to 80 and so on. 

The existence or absence of minor clusters between ma- 
jor clusters can be explained with the accuracy n. Only 
if the accuracy leaves enough classes between two major 
clusters a minor cluster can survive in between. 

A similar bifurcation diagram for the differential equa- 
tion describing the same heuristics is in lfT6l . 

In figure |6] we see the bifurcation diagram for the HK 
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Figure 6: Bifurcation diagram for the HK model, n = 
1001, fc = 50,..., 300. 

model. In contrast to the WD diagram the processes in 
this diagram have converged completely. Going form 
k = 300 down to 50 we see one central cluster, then 
at A: = 190 a bifurcation into two major clusters occurs 
while very little mass remains in a central cluster Then 
(k=175) we get into an interesting phase where consensus 
strikes back, but not for all k, sometimes we end up in 
three clusters. The outer clusters begin to drift outwards 
away from their old position. Consensus in this fc-phase 
happens due to very slow convergence to the center like 
in figure[3] The last consensus appears at fc = 153 (where 
convergence lasts 21424 time steps). Then the existence 
of the two outer clusters and their outward drift is sta- 
ble until the central cluster bifurcates again on a shorter 
time scale (two major clusters k = 100, 99, 98, consensus 
strikes back k = 97, . . . , 89, then stable 5 clusters) and 
so on. Remarkably is that we reach a consensus at the 
HK Markov chain for e — k/n > 0.19 but in the tested 
agent-based model (figure |2l) with 200 agents the chance 
for consensus is only for e > 0.23 fair 

The interactive Markov chains raises the question: Is 
it important to have an even or odd number of opinion 
classes? In other words, is it important to have a central 
opinion class? The impact of the existence of a central 
opinion class is very high for the HK model as we see in 
figure |2l For the WD model the bifurcation diagram for 
n = 1000 looks just as figure|5] 
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Figure 7: Bifurcation diagram for the HK model, n 

1000,fc = 50, ...,300. 



There are two differences between the HK bifurcation 
diagrams in figures |6] and |7] which are generic for other 
other pairs n,n + 1. First, the bifurcation from consen- 
sus to polarization occurs earlier for even n (at k ~ 200) 
and the central clusters disappears totally at that bifurca- 
tion and nucleates again some fc-steps later Second the 
'consensus strikes back' fc-phase changes into a polariza- 
tion phase, but with major clusters closer to the center As 
for n = 1001 this is not stable in that fc-phase, for some 
values we reach two outer majors and a central cluster. 

Both phenomena can be explained through the meta- 
stable state that we reach after the first time steps (in figure 
|3]at t = 10). For an odd number of opinion classes we 
have a central cluster consisting of only one opinion class, 
while for an even number of opinion classes the central 
cluster contains two opinion classes. 



at specific e, existence of outliers) appear also and even 
more drastic in the Markov chain models. We show that 
two properties which may be seen as artifacts are intrinsic 
to the dynamical behavior. 

The WD model leads for equally distributed initial dis- 
tributions to major clusters which lie as far from each 
other, that it is possible for small cluster to survive be- 
tween them, but only for great n and not too low k. The 
existence of minor clusters depends also on ^. 

The HK model leads to major clusters only (except the 
central cluster, which may be small). In the center we can 
reach a meta-stable state with two major clusters, a cen- 
tral cluster and between major and central cluster small 
clusters, which attract the big ones very slowly to the cen- 
ter An even number of opinions lowers the chances for 
central consensus because the central mass can split. 

In future research we should ask how robust the results 
are with other initial distributions. A first but not system- 
atic calculation leads to the hypothesis that the basic fea- 
tures (clustering in pairs, space for minor clusters for WD 
and meta stable states with long convergence for HK) also 
characterize the dynamics for other initial distributions. 
Further on stabilization should be proved. 

The heuristics of these opinion dynamic models is not 
based on quantitative data. Thus, they can not predict 
quantitative opinion clustering. Conclusions about real 
opinion dynamics should be drawn in a qualitative man- 
ner that links the heuristics of the model to the dynamical 
outcome, in a way like: Bounded confidence in opinion 
dynamics about 'continuous' topics leads to clustering. 
Pairwise communication produces minorities while aver- 
aging over all acceptable opinions may lead to meta-stable 
situations where consensus is possible but reaching it will 
take very long. 



4 Conclusion 

We summarize. The basic dynamical feature of both mod- 
els is: Stabilization to a fixed point and fixed points are 
opinion distributions where the mass clusters in pairs of 
adjacent classes which have distances greater than fc to all 
other pairs. This coincides with the agent-based models 
(neglecting the clustering in pairs of opinion classes). The 
differences in the agent based models (number of clusters 
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